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AF®Rology Intro 


• Course and Exam 

■ College level courses offered in high school 

■ Revised course in effect fall 2012 

■ AP Exams are given annually in May 

• Revised course 

■ Reduction in breadth of content 

■ Increase in depth via application of science practices 

• Exam 

■ Standardized national assessment in support of students’ 
application for higher ed credit and/or placement 
considerations 


More thanl 90,000 test takers in 2012 


The Beam AJirnrostmtiori 


Secure proctored school-day administration 
Administered by high schools 
Designated date and time (May 13, 2013; 8 am) 
Paper and Pencil 
3 hours 

■ 90-minute multiple-choice section 

■ 63 Multiple Choice 

■ 6 Grid-in 

■ 90-minute free-response section 

■ 2 Long (e.g., 10 point) 



Assessment of Gbntent Knowledge and 
Science Radices 


Evidence Centered Design applied 
for the course and exam review 



Three Gitical EtDEhases (Gburse &Exam) 



.Assessment of Gbntent Knowledge and 
Science Radices 


• Experts with disciplinary content knowledge 
unpacked the domains, resulting in the content 
outline 

■ Big Ideas (level 1 ) 

■ Enduring Understandings(level 2) 




different chemical and 
physical propeibes, Ifielt t«e 
in the enwronmenl varies 



3 pollutants rarely occur singly In tin 
ermonment, our ability to predict 
effects ol comptei matures it limited 


3 natural factors influencing 
ecosystems mar make it aimcuit 
to understand Hie imoacls of 
pollutants on those ecosrstems 




\ 
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4 Population control efforts, 
while widely variants across 
lire globe nave ffiepotenbal 


often difficult to evaluate m cases 
of environmental degradation 


to substansally stow global 
copulation growth 




3 while (adoring in eci 
and other variables Is important, 
successful regulations must pe 
baseo on sound science 













































Qitical Design Element: Naming Cfoj ectives 


Marriage of the 2nd level of science 
practices with the 3rd level of the 

content outline 





Science claims and evidence 


Bioloav Concept Outline 

i 

i Science Practices 


1 -4 

Big Ideas 

! 1 -7 


1A-4C 

Enduring Understandings 

1.1 -7.2 


1A1 -4C4 

Essential Knowledge 

1.1.1 -7.2.5 


1 Ala - 4C4b 

Additional detail 

i 

! 


Learning Obj ective (Qairn) = Essential Knowledge + Level 2 
Science Practice 


Exairqple L.O.: (1C3 & 5.3): The student is able to evaluate given 
data sets that illustrate evolution as an on-going process. 


Evidence is derived from fourth level of the Concept Outline and 
the Level 3 Science Practices 
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Food Wfeb Example 


Coyote 


Hawk 



Big Idea 4 

■ Biological systems interact, and these systems and their 
interactions possess complex properties 


Enduring Understanding 4. A 

■ Interactions within biological systems lead to complex 
properties 
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The teaming Cfoj ective 


Essential Knowledge 

4. A 6: Interactions among living systems and 
with their environment result in the 
movement of matter and energy. 

Science Practice 

1.4: The student can use representations and 
models to analyze situations or solve 
problems qualitatively and quantitatively 

Learning Obj ective 

4. 15: The student is able to use visual 
representations to analyze situations or 
solve problems qualitatively to illustrate how 
interactions among living systems and with 
their environment result in the movement of 
matter and energy. 
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Beam question 


The following is a food web for a meadow habitat that 
occupies 25.6 km2. The primary producers’ biomass is 
uniformly distributed throughout the habitat and totals 
1,500 kg/km2. 



Meadow Grasses 


Developers have approved a project that will permanently 
reduce the primary producers’ biomass by 50 percent and 
remove all rabbits and deer. 

Which of the following is the most likely result at the 
completion of the project? 


A) The biomass of coyotes will be 6 kg, and the biomass of 
hawks will be 0.5 kg. 

B) The biomass of coyotes will be dramatically reduced. 

Q The coyotes will switch prey preferences and 
outcompete the hawks. 



There will be 50 percent fewer voles and 90 percent 
fewer hawks. The following is a food web for a meadow 
habitat that occupies 25.6 km2. The primary producers’ 
biomass is uniformly distributed throughout the 
and totals 1,500 kg/ km2. 

C c 
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The teaming Cfoj ective 


Essential Knowledge 

4. A 6: Interactions among living systems and 
with their environment result in the 
movement of matter and energy. 

Science Practice 

1.4: The student can use representations and 
models to analyze situations or solve 
problems qualitatively and quantitatively 

Learning Obj ective 

4. 15: The student is able to use visual 
representations to analyze situations or 
solve problems qualitatively to illustrate how 
interactions among living systems and with 
their environment result in the movement of 
matter and energy. 
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Exam Form. Assembly ^Dedfications 


• Articulates standard distributions of Learning Qbj ectives, 
thereby ensuring like distributions of both 

concepts/ content and practices 

• Items written to these specs 

• Free response questions provide opportunity to cover 
application of science practices 



Example Free Ftesponse Question 


A population of microscopic eukaryotic organisms growing in a large 
flask had the growth pattern shown. 


Period ] ftiriod 2 



In one paragraph, explain the biological factors that determine the 
shape of the growth pattern shown above in both period 1 and 
period 2 , 


j^MUegeBoflld 1 
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Example Free Ftesponse Question 


Essential Knowledge 

2.D. 1: All biological systems from cells and 
organisms to populations, communities, and 
ecosystems are affected by complex biotic 
and abiotic interactions involving exchange 
of matter and free energy. 

Science Practice 

5. 1: The student can analyze data to identify 
patterns or relationships. 

Learning Obj ective 

2. 24: The student is able to analyze data to 
identify patterns and relationships between a 
biotic or abiotic factor and a biological 
system (cells, organisms, populations, 
communities, or ecosystems). 
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Example Free Ftesponse Question - Scoring 


3 points maximum. 1 point for each correct explanation of the pattern 
or relationship between the environmental factor and the biological 
system* * 

Possible explanations include the following: 

* Recognition of exponential growth due to lack of limiting factors; 
reproduct ive/growth rate tar exceeds death rate, 

* Slowing of reproductive/growth rate due to the influence of 
density- dependent limiting factors. 

* Death rate beginning to approach reproductive/ growth rate in 
transition from period 1 to period 2* 


* Accumulation of toxic wastes increases death rate and decreases 
reproductive rate* 



Score Importing: Students 


Students receive a score of 1 through 5 which is reported 
to colleges and universities if desired 


AP Score Qualification 

5 Extremely well qualified 

4 Well qualified 

3 Qualified 

2 Possibly qualified 

1 No recommendation 



Scoring 


Multiple-Choice Section 

■ Scanned, number correct 

Free- Response Section 

■ Scored on-site at AP Reading in June 

■ 7-days 

■ Approx. 500 readers - higher ed faculty and AP teachers 

■ Analytical rubrics, no. of points summed for section score 

Weighted composite = 50% MC + 50%FR 

Cut scores for 1 through 5 determined via standard 
setting 




* instructional FlaimiiKj Report summarizes their students’ 
performance relative to total test takers that year 

■ Their group’s mean and global mean 

■ Number of students in their group in each quartile 


• Multiple-Choice section subscores at Big Idea level 


• Subscores for each Free Response Question 



Store comparability 



• Scores on the 1 -5 scale are comparable across 
administrations 

• Score linking analyses rely on embedded common item 
anchor block in each form and equivalent group spiraling 
of forms 

• Each year five forms are required: 

■ Main, Alternate and Exception Domestic 

■ Main and Alternate International 



Radical Issues for Development & Maintenance 


• Development timeline 

■ Curriculum Framework completed Summer 2010 

■ - 3 years until commencement of 1 st exam, May 2013 

■ Included special data collection studies such as think-alouds 

• Challenges 

■ Including broad spectrum of stakeholders in all phases of 
development process 

■ Designing a secure, 3 hour max. exam that met desired 
content and psychometric requirements 

■ Item Writing 

■ A very tall order for item writers to craft items to the claims, 
writing items to the specs 

■ Couldn’t rely on traditional cadre of item writers 




Summary: Innovations in large- Scale Science Assessment 


• Constructs: 

■ Learning Objectives for AP Biology Course 

• Observations 

■ 3 Hour Multiple-Choice and Free-Response Format 
Exam 

• Outcome Space/ Interpretations 

■ Degree of preparedness to place out of 
introductory college level Biology Course 




Summary (cont. ) 


• Measurement models 

■ One composite weighted raw score (MC + FR) 

■ Cutscores based on standard setting and comparability 
study results 

■ Classical Test Theory 

■ NEAT linking design 

■ Randomly equivalent groups design 

• Demands and challenges 

■ Significant challenge in training item writers to craft items 
in accordance with much more constrained specifications 
than is typically considered 




College Board website links 


• Colleqeboard. com 

• AP Central V\febsite 

Apcentml. collegeboard. com 

• AP Biology Course and Exam Description available 
electronically at the link below. 


http://apcentraI.colleqeboard.com/apc/public/reposLtoiy/AP RoloqyCtU Effective Fall 2012 lkcLpdf 




